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LONG-TERM  GOALS: 


The  long-range  aim  of  this  work  was  to  improve  our  understanding  of  the 
atmosphere  through  the  development  of  new  methods  for  forecasting  and  for 
extracting  information  from  raw  time  series  data. 


SCIENTIFIC  OBJECTIVES: 

The  specific  aim  of  this  project  was  to  develop  and  refine  nonlinear  forecast 
methods  as  tools  to  analyze  atmospheric  field  observations  with  a  view  toward 
the  following:  (1)  to  diagnose  the  underlying  dynamic  mechanisms  driving 
barometric  time  series;  (2)  to  determine  the  effectiveness  of  nonlinear 
predictive  methods  in  forecasting  atmospheric  phenomena;  (3)  to  document 
and  better  understand  the  scale  dependence  of  predictability  in  atmospheric 
data. 

Both  the  long-term  goal  and  scientific  objectives  have  been  satisfied,  as 
described  below. 

TECHNICAL  ACCOMPLISHMENTS 


1)  Data  procurement: 

From  BMRC,  Melbourne,  we  obtained  daily  time  series  of  station  barometric 
pressures  for  38  sites  around  Australia.  In  addition,  we  obtained  three  years 
of  daily  ECMWF  forecasts  for  Sydney  and  Perth.  These  data  were  used  to 
demonstrate  how  the  methods  developed  by  this  project  (described  below)  can 
significantly  improve  existing  ECMWF  forecasts. 


2)  Methods  Development: 


i)  Developed  the  method  of  residual-delay  maps  (ROMs)  to  measure  the  degree 
of  nonlinearity  in  a  time  series.  This  method  identifies  and  extracts  the 
functional  form  of  low-dimensional  nonlinearity  from  raw  station  data  (see 
figure  1).  It  effectively  allows  one  to  empirically  deduce  the  nonlinear 
component  of  an  equation  of  motion.  We  have  shown  how  the  RDM  can  lead  to 
marked  improvements  in  local  forecasts  based  on  the  ECMWF  output  (see 
below).  A  residual-delay  map  is  generated  by  plotting  the  residuals  (binned) 
from  a  linear  AR(3)  model  against  the  barometric  pressure  from  the  previous 
day. 

ii)  Adapted  the  method  of  anisotropic  variances  as  a  simple  corroborative 
method  to  measure  the  degree  of  nonlinearity  in  a  time  series.  We  found  that 
when  raw  pressures  at  time  t  are  plotted  against  pressures  at  t-(-l  the 
anisotropy  of  variances  could  be  used  to  characterize  the  nongaussianity 
(associated  with  nonlinearity)  of  the  time  series.  This  is  a  simple  yet  effective 
test  to  refute  the  null  hypothesis  of  linear  dynamics. 

SCIENTIFIC  RESULTS; 

(i)  Using  the  method  of  residual  delay  maps  (RDM),  we  uncovered  a  very 
strong  and  distinctive  nonlinear  signature  in  the  data  for  temperate  stations. 

As  shown  in  figure  1,  the  graph  of  the  binned  residual  against  the  lagged 
barometric  pressure  has  a  distinct  V-shape  at  the  temperate  stations.  This 

quadratic  nonlinearity  was  found  to  be  fully  stationary  on  the  inter  annual 
time-scale,  and  present  in  all  seasons. 

(ii)  A  latitudinal  gradient  in  atmospheric  nonlinearity  was  empirically 

demonstrated  (figure  2).  The  tropical  sites  are  essentially  linear  (no  structure 
in  the  RDM  and  isotropic  variances),  while  the  temperate  sites  are  decidedly 
nonlinear  (a  clear  V-structure  in  the  RDM  and  anisotropic  variances).  This 

empirical  finding  supports  the  prevailing  view  about  the  importance  of 
nonlinearity  in  models  for  the  temperate  region. 

(iii)  One  of  the  compelling  reasons  for  adopting  nonlinear  time  series 

methods  is  the  possibility  that  some  of  the  complexity  (unexplained  variance) 
in  the  time  series  originates  from  the  nonlinear  interaction  of  a  few  variables, 

as  opposed  to  the  more  conventional  view  that  such  unexplained  variance 

reflects  the  action  of  many  variables  (high  dimensional  effects).  The  stronger 


nonlinearity  in  the  temperate  regions  may  explain  the  apparent  noisiness 
observed  in  temperate  barometric  pressure  series. 

iv)  We  uncovered  evidence  to  explain  the  mechanism  for  the  V-structure  seen 
in  the  temperate  data.  We  showed  that  the  V-structure  arises  from  the 
asymmetry  in  time  scales  of  high  pressure  regimes  (persistent)  versus  low 
pressure  regimes  (more  ephemeral).  This  was  a  very  surprising  result  and 
supports  the  hypothesis  that  atmospheric  phenomena  can  be  partitioned  -into 
linear  and  nonlinear  components. 

(v)  We  found  that  the  ECMWF  model  does  not  reproduce  the  degree  of 
nonlinearity  (from  the  above  mechanism)  that  is  observed  in  the  station  data 
(figures). 

(vi)  We  found  that  ROMs  applied  to  ECMWF  forecasts  for  Sydney  can  reduce 
average  out-of-sample  forecast  error  for  extreme  climatic  events  by  more 
than  an  order  of  magnitude  (from  ~2.8hPa  to  ~0.25  hPa)  (figureS). 

SCIENTIFIC  IMPACT: 

i)  We  demonstrated  that  barometric  pressure  in  the  temperate  zone  has  a 
distinct  nonlinear  component,  and  that  this  low-dimensional  nonlinearity  can 
be  extracted  from  time  series  data.  This  is  probably  the  clearest  empirical 
documentation,  based  on  observed  time  series  for  the  existence  of  low 
dimensional  nonlinear  dynamics  in  the  atmosphere  to  date.  It  is  also  the  first 
study  to  actually  extract  the  functional  form  of  nonlinearity  from  any  natural 
time  series  (after  Crutchfield  and  McNamarra  1987,  for  model  time  series). 

ii)  The  mechanism  uncovered  to  explain  the  V-structure  (the  asymmetry  in 
time  scales  of  high  pressure  regimes  (persistent)  versus  low  pressure  regimes 
(ephemeral))  has  several  profound  implications. 

a)  First,  insofar  as  the  ECMWF  output  is  concerned,  it  identifies  a  source  of 
error  which  has  not  been  properly  modeled  in  the  current  state-of-the-art 
numerical  forecasting  model.  It  provides  a  means  for  correcting  this 
shortcoming,  in  the  form  of  a  statistical  correction  term.  This  is  similar  to 
MOS,  however,  here  there  is  a  mechanism  for  the  effect.  I  have  been  told  by 
Lenny  Smith  (Oxford/Reddding)  that  this  correction  will  soon  be  implemented 


for  ECMWF. 


b)  It  provides  a  general  understanding  of  the  effect  of  spatial  scale  (grain)  on 
model  output,  and  a  general  method  to  significantly  improve  local  forecasts 
from  spatially  averaged  models  such  as  ECMWF.  Thus,  until  a  more  expensive 
fine-grained  satellite  monitoring  and  numerical  modeling  system  is  in  place, 
this  correction,  is  a  reasonable  and  very  inexpensive  stop-gap. 

c)  It  supports  the  hypothesis  that  atmospheric  phenomena  can  be  partitioned 
into  linear  and  nonlinear  components. 

iii)  The  RDM  applied  to  ECMWF  output  greatly  improved  out-of-sample  forecasts 
(obtained  an  order  of  magnitude  reduction  in  mean  forecast  error  during 
extreme  climatic  events  at  Sydney).  Again,  as  we  are  told  is  soon  to  be 
implemented,  this  could  be  applied  in  operational  forecasts  in  the  form  of  a 
statistical  correction  term  (similar  to  MOS,  however,  with  a  mechanism  for  the 
effect). 

Finding  a  practical  way  of  reducing  systematic  forecast  error  by  more  than  an 
order  of  magnitude  is  seen  to  be  one  of  the  more  significant  contributions  of 
this  project.  That  this  is  being  implemented  in  various  locations  speaks  for 
itself. 

TRANSITIONS: 

i)  Extend  the  analysis  of  RDMs  to  temperature  time  series. 

ii)  See  whether  binned  residuals  against  lagged  pressures  will  produce 

functions  having  the  same  geometry  on  other  time  scales.  That  is,  does  the  V- 

shaped  function  which  was  observed  for  the  daily  scale  repeat  on  longer  time 
scales?  Or  is  there  a  systematic  change? 
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